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SYSTEM AND METHOD FOR SIMULTANEOUS BROADCAST 
FOR PERSONALIZED MESSAGES 

5 

RELATED APPLICATION 

This patent application claims priority to U.S. Provisional Application Serial No. 
60/236,990 filed September 29, 2000 by Haberman et al., which is hereby incorporated by 
reference. 

1 0 TMs patent application is also a continuation-in-part of and claims the benefit of 

U.S. Application No. 09/545,015 filed on April 7, 2000, which is incorporated herein by 
reference. 



FIELD OF THE INVENTION 
15 This invention is directed towards media (video, audio, text, graphics, etc.) creation 

and delivery, and more particularly towards a system for creating, delivering, and 
assembling personaUzed messages based on user information. 



BACKGROUND 

20 Marketers have come to rely on demographic solutions to estabhsh patterns and 

trends about the purchasing habits of customers and how these habits relate to purchases, 
demographics, and other factors. Alongside companies' proprietary databases, third party 

data warehouses have evolved, fasliioned by many companies who share information either 
about specific customers or about data extracted &om their customer bases. In both cases, 
25 advertisers use the derived information to generate observations relating to their markets, 
target individuals to different types of offerings and select appropriate media purchases for 
advertising. 

In the case of video advertising media, e.g., video tapes that are mailed, internet 
video streams, or broadcast television (whether via terrestrial, cable, satellite, or any other 
30 distribution medium) advertising - there are only Umited means to produce and/or deliver 
personalized versions of the advertisements that directly take advantage of the information 
available about consumers purchasing habits and the like. Mostly, this reflects the nature 
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(such as bandwidth constraints) of the traditional delivery media for video, which provide 
very limited capability to deliver anything more than a common message. 

Fig. 1 shows the global layout of a broadcast delivery chain as deployed today. In 
this model, each source has a separate channel to all receivers (which can be separate set-top 
5 boxes, televisions, etc.). The same information is saad to all receivers. If someone wants to 
create a source that must only go to a subset of the receivers, they must create a new channel 
and limit the receivers to only receive that channel they are entitled to show. Personalization 
creates different variants of the source for different receivers. Potentially this can lead to a 
different variant for each receiver. Adding personalization to this model would mean that, 

10 worst-case, every source would need a separate channel to every receiver, which is 

impossible under the current bandwidth limitations. Basically every user would need a high 
bandwidth point-to-point connection to the source. Although current VOD (video on 
demand) systems deployed on digital networks provide high bandwidth channels to viewers, 
these systems are still very expensive, and can only serve a limited percentage of the total 

1 5 subscriber base simultaneously. Thus, within the currentiy existing bandwidth constraints, 
only a few different variations of the same channel can be transmitted simultaneously, 
allowing personalization only for a few viewers, or very limited personalization for large 
groups of viewers. This makes the tfadeoff between bandwidth lost and capabilities gained 
not interesting enough. There really must be a higher level of personalization for a larger 

20 amount of viewers with the same bandwidth tradeoff before this becomes interesting. 

In addition to the limitations imposed by the delivery medium, no advertiser is going 
to create/produce many different versions of one and the same message, simply because 
there is no time and/or resources to create the required diversity. The nature of video 
production, focused typically on one sequential video story, does not allow for incremental 

25 content changes. This forces advertisers to avoid topically relevant information and 
offerings. 

As such, even though companies know a tremendous amount of information about 
their customers, the ability to leverage this information has been limited by the nature of 
video creation/production and the fundamentals of the broadcast medium, requiring a bland 
30 vanilla message to be sent to all customers. 
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SUMMARY 

The present invention provides for a system for the simultaneous 
creation/production, delivery/transmission, and assembly of synchronous multiple 
personalized messages to specific targeted individuals, households, or other entiti^. The 
5 system can said rich media distinctly personalized messages to a small or large group of 
selected individuals through any appropriate distribution media. 

The present invention includes a system and method for allowing the creation of a 
plurality of personalized messages comprising creating a personalized message template 
with a plurality of slots in sequence, wherein at least one of the slots can include one of a 

10 plurality of different segments, with all segments for a particular slot being a same lengfli. 
The method includes providing a plurality of data streams to a receiving unit, each data 
stream delivering a different one of the plurality of segments for the at least one slots, 
wherein the segments are synchronized to begin and end at substantially the same time, and 
providing content selection information regarding content of the plurality of data 

1 5 streams to the receiving unit, the information iucluding switch times for the plurality of 
synchronized segments, to allow the receiving unit to select among the plurality of data 
streams for one of the segments for the particular slot, to assemble a personalized message. 

The present invention also includes wherein the receiving unit selects among the 
plurality of data streams in real time, and also wherein the personalized message is viewed 

20 by a viewer as it is assembled. The receiving unit can select among the plurality of data 
streams based on the content selection information and information about a viewer who will 
view the personalized message. Further, a data stream may be provided with a default 
personalized message to allow the receiving unit to display the default personalized message 
without selecting between the plurality of data streams. The plurality of data streams may 

25 be MPEG encoded data streams, mid ftirther the plurality of data streams can be multiplexed 
into a transport stream. 

The present invention also includes wherein the segments are incomplete parts of a 
personalized message. Further, the present invention includes wherein the receiving unit is 
a set top box. The set top box can receive both analog data streams and digital data streams, 

30 and the set top box can momentarily switch from an analog data stream to a digital data 
stream to play out a personalized message. Further, the set top box can switch from an 



-3- 



wo 02/28102 PCT/USOl/29958 
analog data stream to a digital data stream triggered by VBI data. Alternatively, thee set top 
box can momentarily switch from a first digital data stream to a second digital data stream 
to play out a personalized message, however triggered. The set top box can receive a 
plurality of television channels over the data streams, and the channels include programs 
5 include a synchronized commercial break. During the synchronized commercial break, the 
data streams deliver segments to create a personalized message for display irrespective of 
which channel the set top box had selected. 

The present invention also includes transition segments, which are inserted into the 
personalized message between the segments. Further it includes a plurality of templates for 

1 0 creating the personalized messages, wherein the templates include video sequence templates 
and audio sequence templates. 

The present invention also includes a system and method for delivering a plurality of 
different messages over a television transmission network, including creating a plurality of 
different media segments, wherein the different media segments include incomplete sections 

15 of a complete message, and wherein at least one subset of the media segments are a same 
length. It includes transmitting a plurality of television programs to a television signal 
receiver, wherein the plurality of television programs have at least one synchronized 
commercial break; and during the synchronized commercial break, transmitting the plurality 
of different media segments to the television signal receiver, wherein all media segments in 

20 the at least one subset are transmitted simultaneously. The present invention turther 

includes directing the television signal receiver to switch to one of the media segments in 
the subset as the media segments in the subset are received; and wherein after the 
synchronized commercial brealc, the television signal receiver switches to a previously 
selected television program. 

25 An illustrative embodiment of the present invention provides all of the following 

functions: 

Acquire and compile information that delineates the profiles of groups of 

individuals, enterprises, organizations or any identifiable entities. This information may be 
acquired through data mining organizations, collaborative profiling with the input of the 
30 entity to be characterized, regional and local demographics, the client customer, or other 
sources of information. This uiformation will be organized in a special target entities 
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information database. These profiles will be used to control specific profile driven message 
insertion and assembly units. 

Acquire current information concOTung news, weather, business conditions, user 
responses, and/or the status of any conditions relevant to the messaging content and/or 
5 context. 

Provide for the creation, acquisition, synthesis, storage, and generation of 
multimedia (e.g., video, audio, still images, and text) modular information segments that 
can be geaerated and assembled utilizing entity profiles to drive rules based expert systems 
incorporated in message sequence templates. This information would constitute a resource 

1 0 hbrary from which custom presentations for target individuals, or other entities could be 

assembled for the purpose of advertising, instruction, promotion, political persuasion, or any 
informational agenda. This material will be available through a special media database 
addressable via the semantics of composition. 

Simultaneously and synchronously insert multimedia modular information segments 

15 and other information into the appropriate slots in a broadcast transmission stream for 
delivery to the entire selected group of users or entities at their media specific location. 

Determine a message slot template based on which a profile driven assembly unit 
assembles personalized messages from the set of multimedia modular information segments 
and other information based upon each entity profile and its associated rules. 

20 Track and verify all messages and provide for client reports and billing as required. 

Also monitor and receive responses if required or needed and analyze and compile such 
information for tibie client user. 

U.S. patent 4,573,072 issued to Freeman, describes a system for switching between 
complete commercials sent over multiple channels, to allow different commercials to be 

25 displayed to a viewer, depending upon the viewer's interactive choices for commercial 
preferences. However, this patent only allows selection of substantially complete 
commercials, and has no disclosure of being able to assemble a personalized message in real 
time, both in terms of multiple segments for a message, but also in terras of various 
incomplete media components such as multiple and separate audio, video, graphics, 

30 rendering, and last minute information. Freeman also does not disclose both the 

synchronous and simultaneous itisertion of modular incomplete media components to allow 
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seamless assembly into complete personalized messages, which is enabled by digital 
television. Further, Freeman discloses using minimal or no criteria for selecting which 
commercial to show. 

An advantage of the present invention includes an ability to deliver and distribute 
5 personalized messages over communication channels with present-day bandwidth 
limitations using present-day (already deployed) hardwai-e and technology. 

Another advantage of the present invention includes a system which allows for the 
efficient creation, production, dehvery, transmission, and assembly of a very large number 
of person^ized messages. This can typically be done at the same or lower cost (bandwidth, 
1 0 labor) required for doing the same steps for a few messages independent from each other. 



BRIEF DESCRIPTION OF THE DRAWINGS 



The foregoing and other features and advantages of tlie present mvention will be 
1 5 more fully understood from the following detailed description of illustrative embodiments, 
taken in conjunction with the accompanying drawings in which: 

Fig. lis a block diagram showing a typical one to all broadcast television approach; 
Fig. 2 is a block diagram showing a one to all broadcast television approach with 
additional data provided in accordance with the present invention; 
20 Fig. 3 is a block diagram of multiple segments for sunultaneous broadcasting; 

Fig. 4 shows a set of audio and video templates for an example personalized 
message; 

Fig. 5 illustrates how overlapping slots occur for an example personahzed message; 

Fig. 6 shows an example video template for a vacation commercial according to one 
25 embodiment of the present invention; 

Fig. 7 is a block diagram of personalized data stream creation from simultaneous 
broadcast according to the present invention; 

Fig. 8 is a data stream prepared according to one embodiment of the present 
invention; 

30 Fig. 9 provides head-end processing steps for personalization according to the 

present mvention; 
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Fig. 10 provides details of distribution of responsibility in a receiver software 

system; 

Fig. 1 1 shows details of a personalization engine, within a receiver; 
Fig. 12 is a block diagram of a typical receiver for digital television; and 
5 Fig. 1 3 illustrates the resulting transport stream layout according to the present 

invention. 



DETAILED DESCRIPTION 

The goal of personalized messages is providing viewers with programs, messages 
10 and commercials that are more relevant given their personal situation. Personalized 

messages can be part of traditional broadcast (digital) television, advanced broadcast 
(digital) television (incl. video on demand) or streamed programs on the Internet (just like 
ordinary conmaercials). Some sample embodiments include Personalized Ads, Personalized 
News, etc. 

15 An important feature of personalized messaging is that the production of the 

personalized messages only requires hmited extra effort compared to current messages 
(such as commercials). A solution to this requirement is described in detail in U.S. • 
Application No. 09/545,015 filed on April 7, 2000 of which the present appHcation hereby 
incorporates by reference. Generally, a system according to the invention works as shown in 

20 Fig. 3. A complete message or commercial 64 is segmented in a number of different 

(time)slots 66. Each timeslot can have an arbitrary length, as small as a second, or even less. 
The present invention allows for multiple options 68 per slot. Depending on the individual 
characteristics of a viewer, for each slot a different option 68 is chosen. This way, with a 
limited amount of additional effort during production many different instances of the 

25 commercial 64 can be created. For example, using the 13 segments 68 as shown in Fig. 3 
(instead of 5 in a linear, single, commercial), a system according to the present invention 
can generate 36 (2x3x6) different instances of the commercial 64. 

The present invention provides for the abiUty to customize personalized messages at 
the location in the delivery chain which best suits the requirements for personaUzation and 

30 delivery constraints. By selecting the best option for each slot to be played in the receiver 
(whether the set top box 58 or television 60, see Fig. 2), a last minute edit phase is added to 
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the broadcast chain. By creating different variants of each slot, the present invention can 
create multiple versions of an entire audio feed, video feed, or TV channel, by combining 
the parts in different ways. By labeling the parts witii personalization information 62, and 
distributing a user profile to near the end of the broadcast chain, for example to the STB 58, 
5 the STB 58 can make the final selection fi-om the parts by matching the personalization 
information 62 against the user profile for each of the possible choices. That way the STB 
58 creates a path through the entire set of content and presents the viewer with the best 
possible personalized television content. 

As an alternative embodiment, the selection of segments may be performed on a 

10 pseudo-random or complete random fashion, to allow different variations of a personalized 
message by an audience. Any combination of selected segments by user profile 
personalization plus some randomness may be performed. Further, a system may keep track 
of which segments were previously shown to any audience, so in a next transmission, 
different segments not before seen by the audience can be shown. 

15 In its most simple case, each slot 66 contains both audio and video (i.e., both have 

the same template structure), but it is possible to have separate templates 72 Fig. 4 for audio 
and video. The reasons for having different templates for audio and video are twofold. The 
first reason is an artistic one. Creative artists and authors of personalized ads generally want 
different variations in the audio and the video flow. The second reason is technical. In 

20 currently existing audio coding standards (including AC-3, MPEG-2, and many others), 
audio samples are grouped into fi"ames (having a length of, for example, 32 milliseconds). 
This means that audio slots must be ahgned at audio frame boundaries to be able to make a 
seamless switch from one slot to the next. If the slots are not aligned on frame boundaries, 
the slots must be padded with silence, which is disadvantageous as it leads to a break-up of 

25 the ad. Given the requirement of aligning audio slots at audio frame boundaries, it is 

difficult to let video and audio slots end at exactly the same time without compromising the 
seamless transition between slots. This means tiiat typically audio and video will have 
different templates. 

For audio it is even possible that each channel (for example, background music, 
3 0 voice-over, sound effects, . . .) has its own template 72. Furthermore it is possible to have 
multiple templates 72 for each video and/or audio channel. The template 72 to use is then 
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selected before the cominercial starts playing (again, based on available knowledge on the 
viewer in viewer projaies). Fig. 4 shows an example of such, a multi-template commercial 
(three different chatmels; two of those have two different templates to choose jfrom). 

Yet another option is allowing overlapping slots in a template as dq)icted in Fig. 5. 
5 The allowed switching between slots in this template is between slots that are exactly 
adjacent. 

Fig. 6 provides a detailed example of a video template set up for a campaign to 
provide personalized commercials for vacationing in Bermuda. Based on the information or 
conjectures about the viewer, an appropriate segment will be selected to display. In this 

1 0 example, demographic information about the viewer allows the present invention to create a 
vacation commercial with great appeal for the viewer. This example template is coded 
using MPEG-2, as will be described in an illustrative embodiment provided below. 

In a broadcast environment, where one source distributes exactly the same content to 
multiple receivers at the same time, each path through the commercial 64 that can be chosen 

1 5 from the templates 72 will need to have the same length. This constraint does not hold in a 
point-to-point situation, e.g., personahzed commercials embedded in VOD, personalized 
news, Internet streaming, etc. In a point-to-point situation the source assembles a specific 
stream for an individual viewer. 

To personalize a commercial 64 for each viewer in accordance with one embodiment 

20 of the present invention, the viewer-specific path through each template of the commercial 
64 (i.e., the selection of the option to play for each slot) will be selected at the latest moment 
possible (Just-In-Time-Advertising- JITA), based on mformation 62, Fig. 2, available on that 
viewer (e.g., from customer databases). 

Another last-minute edit that can be done according to the present invention is the 

25 addition of last-minute information in the form of text or graphics overlays that can be 
added to the conomercial 58 (Fig. 2) at the receiver. This last-minute information can be 
viewer specific (to achieve an even higher level of personalization) or global (e.g., 
information on the amount of products available in stock shortly before the commercial is 
aired). The last-minute information can also be distributed as part of the content selection 

30 data 62 as depicted in Fig. 2. 
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Fig. 7 provides aa overview of personalized advertising in accordance with the 
present invention. Within a digital broadcast transmission 56, multiple individual data 
streams (channels) 50 are present. The present invention uses multiple channels 50 to each 
5 carry a different data segment (slot-option) 70 for a slot 66. The selection of what segment 
70 to play for each slot, and the actual switching between slots is performed as close to the 
final point of dehvery (e.g., a set-top box or a television). As will be described in detail 
below, this selection and switching may be performed in an STB (set top box). Selection is 
done based on rules (e.g., expert system based) expressed in terms of viewer projSles. These 

10 rules can be associated, for example, with templates and individual data-segments. 

To allow a switch 59 to switch between data-segments in data streams 50, the 
segments 70 are broadcast simultaneously on each data stream 50. For this example, three 
data streams 50a-c are shown, data stream 50f will be described below. The switch is 
presently set to data stream 50a, as shown by arrow 61. Since the segments 70 are 

1 5 simultaneously provided, they all have a synchronized end point (as shown by line 65), and 
the next set of segments have a synchronized start point (as shown by line 67). Because 
switching time by switch 59 is not instantaneous, a time gap 69 may be included between 
the end point 65 of one set of segments and the start point 67 of the next set of segments. 
This time gap 69 provides the delay necessary to allow the switch 59 to change seamlessly 

20 from one data stream 50a to another 50b. Output processing 63 may include buffering and 
other processing techniques for the data, for example to eliminate any gaps, or to add 
additional features to the data stream such as graphic overlays, as will be discussed below. 

Although only three data streams 50a-c are shown, the present invention can use as 
many data streams or channels 50 to simultaneously deliver as many segments as needed. 

25 Also, multiple sets of data streams can be stacked into a broadcast, e.g., one set for a video 
template, and one for an audio template. 

One or more additional data streams 50f may be used to carry data which assists in 
using the multiple segments. Such data can include the content selection data 62 Fig. 2, 
which provides information about each segment 70 and the appropriate segment to use. 

30 This information is used by a selection control component 7 1 , which in an illustrative 
embodiment, also uses user profile information to determine which segment 70 will be 
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selected at which time. Alternatively the content selection data 62 is incorporated into other 
data streams which might he delivered via other networks. The illustrative embodiment 
allows delivery of this content selection data in such a way that the entire broadcast remains 
backward compatible with existing receiver equipment. Also, because a default message is 
5 sent in-line with the regular broadcast, receivers that do not support personalization (i.e., do 
not have a software upgrade) will automatically show the default. Therefore, there is no 
reason to replace deployed receivers by personalized receivers when personalized 
transmissions start. 

Another use for the additional data stream 50f is to provide audio, additional 
1 0 graphics, information, and tirausitional data. Audio requires much lower bandwidth than 

video, and therefore several different audio streams can be sent on one data stream, along 
with other data, and then buffered in the receiver (e.g., on RAM or hard-disk) for future 
playback. 

Examples of transitions include fade-ins, fade-outs, moiphs, and vidpes between 

15 video segments, and cross fades between audio segments. These specific transitions (instead 
of clean cuts between segments) are occasionally wanted for artistic reasons. Transitions 
sometimes help in improving the flow of the message. 

Transitional data sent over data stream 50f defines the transitions to be played when 
switching from one segment to the next. One option is transmission of transition 

20 instmctions to the receiver, which then computes/generates the transitions either in software 
or using dedicated hardware. Another option, which requires less processing power in the 
receiver, is that the transitions are transmitted in MPEG-2 format, meaning that the 
transition video and audio streams are precomputed before transmission. The switch 59 may 
select the correct transitional segment to connect a previous segment with a next segment. 

25 As an example, the switch 59 Fig. 7 has three possible segments 70a, 70b and 70c, which 
are followed by three other possible segments 50a, 50b and 50c. There are a total of nine 
possible transitions between the first three segments 70a-c and the next three segments 50a- 
c. This is a simple combinatorial calculation, where the first segment 70a may be followed 
by one of three segments 50a-c, and the same for other first segments 70b and 70c. 

30 Therefore, the solution is to pre-encode all nine possible transitions, and provide them to the 
switch 59 in time to allow the switch 59 to select the proper transition to fill in between the 
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selected first segment 70 and second segment 50, The transitions are relatively small 
compared to the lengths of the segments being provided, therefore all the transitions may be 
provided over the one additional data stream 50f, and stored in a buffer until the correct 
transition is selected and inserted into the output data stream 60. The transitions between the 
5 first segments 70 and the second segments 50 may be provided during the time the first 
segment 70 is being passed thi-ough the switch 59, and kept in a buffer. 

Alternatively, if there are sufficient available data streams 50, the transitions may 
each be sent by a different data stream 50, in a sjTichronized fashion with the regular 
segments, whereby the switch 59 does not need to collect and buffer the transitions ahead of 

1 0 time, but can simply select and switch to the proper data segment 70, wherein some data 
streams 50 include the segments, and some data shreams 50 include transitions. The 
transitions are simply treated as other segments which go in a slot between the normal first 
selected segment and the next. In fact, since the transitions occur in between the segments, 
the data streams carrying the segments may be reused to include some of the transitions, 

1 5 while separate data streams only carry the transitions. Therefore, for the example of three 
data stream carrying three optional segments, with nine transitions, only nine data streams 
are needed to carry the simultaneous transitions, since the three segment data streams may 
also each carry one transition. Also, during the creative process it might be decided that 
certain transitions do not make sense from a story-telling perspective. In that case even less 

20 transition streams might be needed as some combinations of segments will never occur. 

An alternate method for addressing the transition between segments is to make all 
segments 70 start and/or end in a similar manner. This would avoid the use of dedicated 
transition segments for changing between the other segments 70 and require no extra 
bandwidth. 

25 An illustrative embodiment of a data transmission stream 56 coded as an MPEG-2 

transport stream is shown in Fig. 8. The packets belonging to the multiple data streams 76 
are labeled A-E. Packets A-D provide simultaneous delivery of a specific (e.g., video) 

segment, while packets E deliver extra information for example information for switching 
between segments, etc. Other packets 73 provide other channels or information typical to a 
30 multiplexed transport stream. Packets 73 can also be NIL packets. Just before the 

occurrence of a gap 69, there is a switch trigger 74, which may be in the form of a specially 



-12- 



wo 02/28102 PCT/USOl/29958 
coded packet, or a special flag encoded in another packet. The gap 69 (although depicted as 
empty) can contain any packets, such as NIL packets, or packets belonging to other 
information streams. After the gap 69, the data streams including the packets 76 continue 
as before. If fewer segments are needed for the next slot, for example only two optional 
5 segments are used for Ihe next slot, then some packets 75 may be used to send other 
information, or are empty. 

Fig. 9 shows the logical processing steps taken at the transmission side (e.g., in a 
cable head-end) to uisert personahzed messages into an MPEG-2 transport stream. In 
practice these steps are not necessarily in that order or may not even be recognized as 

10 mdividual steps. This depends mainly on the architecture of the insertion equipment and 
may vary from one set-up to another. Since incoming transport streams may carry several 
unrelated channels, the first step is to separate these channels to free up transport stream 
bandwidtli necessary for the parallel insertion of the segments that are part of the 
personalized messages. The next step is replacing the existing ad (if necessary) with the 

1 5 main (default) choice of the personalized ad. After that the system according to this 

embodiment adds the additional choices (segments) for the personalized ad (third step) and 
adds the personaKzation information that informs the STB of the possible choices and 
timing (fourth step). Finally, since channels were removed from the transport stream and the 
personalization information was added, the PSI (program specific information, part of the 

20 MPEG-2 standard) is adapted to reflect the new situation (fifth step). This might include 
adding a private descriptor to the PMT (The Program Map Table, part of the PSI 
information) to signal the presence of personalized messages. Some of the SI/PSIP (DVB 
and ATSC extensions of MPEG-2) information might also have to be adapted to the new 
transport stream layout. 

25 In one embodiment of the present invention, bringing the receiver 5 8 into the 

authoring chain requires changes to the software of the receiver 58, Components of the 
final television program are deUvered to fiie receiver 58 and the receiver assembles the final 
program that best matches the personalization criteria. To a standard digital television 
receiver 58, the features of adding matching of profiles, switching to assemble the final 

30 content, and possibly reporting, are added. Fig. 10 shows a high-level overview of the 
software blocks of one example STB, including the modifications required for supporting 
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personalization functionality. The personalization engine 140, the Reporting and preferences 
application 142, and the middleware extension 144 are personalization specific. 

The Personalization Engine (PB) 140 Fig. 11 is the heart of the slot based TV 
personalization within the STB. It controls the variant for each slot that will be shown to the 
5 viewer and will collect the viewing information for billing and personal tuning. The 

Personahzation Engine 140 sits between the demultiplexer API and its cUent to intercept fbe 
settings for audio and video of the current channel and change them into the personalized 
versions. It uses the demultiplexer API to retrieve personalization control iaformation/data, 
and to control the switching between the right media (audio and video) segments at the right 

10 tune. To allow personalized text or graphics to be overlaid on the video, access to the low- 
level graphics API is also required. To the original client of the demultiplexer API it 
presents the same API, so that the client does not need changes in functionality. Depending 
on the graphics capability of the STB 58, the graphics API may be routed through the PE 
140 in order to shut off any UI graphics for the duration of the text overlay or vice versa. 

1 5 There is one extra bit of information that the PE 140 uses that is not typically 

available at this low level. This information is the PED of the personalization channel where 
the metadata (the information telling the receiver about the number and of slots, the PIDs 
for the slot-options, etc.) is transmitted. There are three possible solutions for this. In 
situations where the middleware has a high abstraction level compared to the HAL 

20 (Hardware Abstraction Layer) API, this information can be extracted from the PMT, which 
is typically parsed inside the OEM specific software. If the PMT is parsed in the 
middleware, there are two options, which are actually viable in all situations. The first is to 
double-parse the PMT: Capture the received PMT in the part of the PE that sits on top of the 
demultiplexer API and extract the infonnation from this parse. There is no guarantee that 

25 the PMT requested by the middleware is the one that is actually used to play the current 
service, however, as the middleware might be pre-caching PMTs. The other way is to 
collaborate with the upluik part of the personalization chain and have a calculated PID 
assignment for the personalization channel. This can be either a fixed offset from a content 
PID or a fixed PID for every transport stream. In the future, middleware may be able to pass 

30 the personalization PID to the PE, similar to the way conditional access is nowadays 
integrated with middleware stacks. 
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The Personalization Engine 140, as part of its normal operation, creates a log of 
activity and viewing information for accounting and further customization. This information 
has to be delivered back to the central server on a regular basis. The way of delivering tiais 
information depends on the capabilities of the network and the STB 58. At a minimum 
5 either a cable modem or a PSTN modem will be present to allow the reporting facilities to 
work, Since these tj^es of modems typically use some forni of IP communication, and the 
middleware stack manages this communication link, it is probably the easiest to work 
through an application implemented on top of the middleware stack. Since one may also 
want to allow user preference settings, one can later extend the apphcation with that 

1 0 fimctionality. For the user interface, the application can take Ml advantage of facilities 
offered by the middleware stack. Since most middleware stacks allow apphcations to be 
downloaded to the STB on the fly, the reporting and preference apphcation can be updated 
with the latest features when necessary. 

Whether or not an embodiment actually needs an application for reporting and 

1 5 preferences depends on the need to get the information to the server and on the need to 
allow users to influence their profile. If there is no need for any of these features, then the 
apphcation will not be there. If only reporting is needed and there is a permanent link with 
the server by means of a cable modem, then the application will have no user interface. 
In order to allow for last minute personalization for each individual receiver, 

20 rendering of extra information such as text, graphics, animations, synthesized audio and 
video is an attractive extra feature. The rendering result is subsequently overlayed over the 
broadcasted audio and/or video segments by the receiver. Rendering of text, graphics and 
animations can be done either at the transmission side (e.g., a head-end) or at the STB 58. If 
rendering is done at the transmission side, the resulting bitmap is placed in the broadcast 

25 transport stream and addressed to one specific STB. Because of bandwidth limitations, the 
rendered result cannot be overlayed with video at the transmission side; this has to be done 
in the receiver. If rendering is done in the STB, only the rendering commands have to be 
transferred. The STB should have sufficient rendering power to allow for this option. For 
both options, the STB must have sufficient graphics capabilities to support rendering with 

3 0 the required number of colors and resolution. For animations, even more processing power 
is required. 
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Graphics rendering on the STB is a difficult functionaHty, The STB resident 
software is Ukely to make use of the same graphics plane of the STB hardware as is required 
for displaying the rendmiig results for personalization. The most portable option is to go 
through the middleware software of the STB, but this may cause timing problems with the 
5 real-time (frame accurate) behavior of personalization overlays. The functionality of the 
overlay handling will need to be placed at a fairly low level within the STB software, and 
executing calls to the middleware API from this level may likely infroduce reenfrancy 
problems within the middleware stack. Also, most middleware APIs can only be called from 
appKcations running on top of the middleware, which is unsuitable for the real-time 
1 0 text/graphics overlay functionality. However, if the system does not use the middleware 

graphics or text capability for the text overlays, there may be a resource conflict with the use 
of the graphics hardware. This conflict can be resolved in several ways: 

Make use of separate graphics hardware planes for overlay and middleware. This is 
obviously only feasible if the hardware contains at least one hardware graphics plane that is 
1 5 not used by the middleware. 

Create virtual graphics planes. This would reqxiire a relatively large amount of extra 
memory for buffering of overlapped graphics information. The code would also need to be 
multithreading safe since both the middleware and the overlay processing will be making 
graphics API calls. It would provide the same level of fimctionality as the multiple hardware 
20 planes, but may affect performance. 

Disable the overlay graphics for the duration of the user interface graphics display. 
This may be difficult to build. There will be a difficulty in predicting when there is no 
relevant user interface activity going on. There may be permanent graphics on the screen to 
signal channel numbers or other information. A better version of tins may be to detect if the 
25 overlay area contains any non-transparent graphics and, if not, allow the overlay to proceed. 
As soon as UI graphics is displayed in the area, the overlay must be removed. 

Disable the user interface graphics for the duration of the overlay. This is probably 
the least acceptable option because the user of the STB will not want his visible information 
to disappear just because a commercial in the background wants to do some text overlay. 
30 However, it is the easiest option to predict, since the exact timing of the overlay graphics is 
known in the personalization engine. It may still require some buffering to allow a restore of 
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the UI graphics once the overlay dis^pears. 

An element in letting the receiver do the final ^sembly of personalized messages, as 
just described in a specific embodiment of the preseat invention, is tbe protocol between the 
transmitter and receiver that allows the receiver to do the fibaal assembly of personalized 
5 messages. This so-called broadcast protocol defines how content material and associated 
metadata and control messages have to be multiplexed into MPEG-2 transport streams. It is 
an extendable protocol framework designed to be backward compatible with existing digital 
broadcast. 

In order to allow reUable hardware independent switching between slots of the 

10 broadcast, the present invention allows one to specially format the transmission of the 
content data of the main and alternative channels. This is helpful because of the buffering 
mechanisms used in digital receivers 58, as illustrated by Fig. 12. This buffering, together 
with the multiplexing of MPEG-2 transport streams make it difficult to reliably switch 
between different content streams within the transport stream without visible or audible 

15 artifacts. In order to circumvent this problem, it is helpM to have a period of silence, or gap, 
69, Fig. 8 in the data stream at the switching point. Due to the multiplexing techniques used 
in an MPEG-2 transport stream, it is possible to create such a gap in. the content flow. 
Sending more information ahead to fill the buffers in the receiver to a higher degree 
achieves this goal. During the gap in the incoming data, the receiver will continue to process 

20 content fi-om the buffer and the de-multiplexing circuitry can be switched safely to one of 
the alternatives, after which the content flow will continue fi:om the new source. 

Fig. 13 illustrates the resulting data stream 58 layout. In this case the content 
selection information added by the personalization application consists of the indicated SIM 
(Sequence Identification Message) 90, SOM (Sequence Option Message) 92 and SEM 

25 (Sequence End Message) 94, while the switch point trigger message is indicated by the 
SPM message 96. In this example the personalized ad comprises two slots 98, which have 
multiple choices of media data (e.g., video), and are preceded by gaps 69 to allow for 
switching time to an appropriate media data segment. The transport stream 58 shown 
indicates a personalized message inserted into a main program while that main program is 

30 the only one present in the transport stream 58. 
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By means of roadblocking the same personalized message could be used for multiple 
programs transmitted in the same transport stream. Roadblocking is used in television 
broadcasting, and means that different television chamiels are broadcasting commercials at 
approximately the same time. This is done to ensure that channel changing (zapping) 
5 consumers will remain seeing commercials, despite their zapping. This will obviously 
ensure that consumere cannot zap away from conmiercials to TV programming; they will 
always zap between commercials. 

A generalization of this approach is roadblocking with the same commercial, 
meaning that during zapping, consumers will see the same commercial at approximately the 
10 same time. 

In the present invention, roadblocking goes one step further, meaning that all 
television channels in one transport stream are aligned such that they switch to tiie same 
personalized corranercial at the exact same (video and audio) frame. This type of 
roadblocking ensures zero overhead in bandwidth in the specific transport stream due to 

1 5 personalization of commercials. The transport stream can contain exactly the same number 
of commercials as a situation with non-pereonalized commercials. 

Detail of various protocols for the illustrative embodiment will now be provided. 
The broadcast protocol messages that are sent over the Meta Information Stream (cf. 5 Of in 
Fig. 7), have at least indications of a personalization message or an overlay message. These 

20 broadcast protocol messages are sent as PES packets or MPEG-2 sections (e.g., private data 
sections). The personalization protocol is an extension of the Broadcast Protocol, 
designed to allow content selection and assembly by the receiver 58 based on transmitted 
personalization information through Ihe personalization protocol messages. The 
personalization protocol assumes that the STB has the user profile necessary to make the 

25 selections from the content information. The personalization protocol claims a message 
type and defines a message framework for all messages belonging to the personalization 
protocol, each identified by a message subtype. The personalization protocol covers the 
following messages: 
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Sequence Identification Message (SIM) 90 

This message indicates the start of a personalization sequence. It assigns an identifier to the 
sequence, which will be used to identify the other messages belonging to the sequence. It 
5 also identifies the PEDs (streams) used for the personalized sequence. It also contains 
(optional) fields for copyright and authoring information. 

Sequence Option Message (SOM) 92 

This message araiounces an upcoming personalization switch pouit. It identifies the possible 
1 0 options, along with the selection criteria that drive the final selection. The message is linked 
to the sequence by means of the sequence identifier. 

Switch Point Message (SPM) 96 

This is an optional message following the SOM, which signals the actual start of the content 
1 5 gap that allows the switching of the decoder hardware to the new setting. It is linked to the 
sequence by means of the sequence identifier. 

Sequence End Message (SEM) 94 

This message signals the end of the entire sequence. After this message the sequence 
20 identifier is no longer valid and may be reused. The message is included for accounting 
purposes and is linked to tiie sequence by means of the sequence identifier. 

A viable alternative to embedding the personalization media segments and control 
messages into the same transport stream as the TV program/channel tlie message is inserted 

25 into, is providing it via a different transport stream. In this altemative embodiment of the 
present invention, the receiver switches to the other transport stream at the moment the 
personalized message is to be played. This is typically indicated by a bigger message in the 
TV channel. Upon receipt of this trigger (which may contain the id of the transport stream to 
switch to), the receiver switches to the transport stream containing the personalized 

30 messaging content and metadata. At the end of playing the personalized ad, the receiver 
switches back to the transport stream containing the TV program. Depending on the 
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capabilities of the receiver, the switch between transport streams might or might not be 
completely seamless. la case the hardware doesn't allow a seamless switch, the switch can 
be camouflaged, e.g., using a fade, a number of black frames, or using some rendered 
graphics. The broadcast protocol itself, as well as the personalization protocols do not need 
5 to be changed in this alternative embodiment. 

A major advantage of this alternative embodiment is the saving in bandwidth when 
many personalized messages are broadcasted, divided over many different TV channels. 
Thus, the personalized messages can be concentrated in one (or a small number) of separate 
transport streams which can be completely filled with personalized messages (depending on 

1 0 the distribution in tune). It can easily be seen that this leads to much less use of bandwidth 
compared to inserting the personalization messages into the same transport streams as the 
TV channels they become part of 

Yet another alternative embodiment of the present invention is a situation where the 
TV channel in which the personalized message will be played is analog instead of digital. In 

15 this situation the ad's media segments and control messages are, again, conveyed in a 

separate (digital) transport stream. In this embodiment, the analog TV channel will contain 
triggers (typically embedded as data in the VBI - Vertical Blanking Interval) that trigger the 
receiver to switch over to the digital transport stream containing the personaUzed message. 
This alternative embodiment would work in most current digital set-top boxes as these are 

20 usually also capable of playing/decoding analog television. The attractiveness of this 
embodiment is that this enables personalized ads in analog television channels. Again, 
depending on the receiver's hardware, the switches from the analog channel to the ad in the 
digital transport stream and back might or might not be seamless, depending on the specific 
capabilities of the hardware in the receiver. Typically, receivers with dual tuners will be 

25 capable of performing a seamless switch. In single tuner systems a camouflage shnilar to the 
one mentioned above might be employed to cover potential switching artifacts. 

The overlay protocol also is an extension of the broadcast protocol. It is used to 
distribute text and graphics messages that must be overlaid on top of the video. It registers a 
message type and defines a Content Data framework message for the different overlay 

30 protocol messages. Overlay protocol messages can be targeted at a specific receiver by 

means of a unique receiver address. In order to identify the personalization option video that 
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the overlay belongs to, the video channel is identified. A subtype identifies the type of 
overlay data that the message contains. The following subtypes are covered: 



Text overlay message. 
5 This is a fixed text string to be overlaid on the video at the specified tune and screen 
location. It allows font specification within the limits of the font capabilities of the 

personalization engine. 

Tagged text overlay message. 
1 0 This message is similar to the text overlay message, but the text may contain tags that are 
replaced with local information by the receiver. This allows the text string to be 
personalized with data that has been downloaded into the receiver. 

Graphics overlay message. 
1 5 This message is used when the rendering of the text has been done at the transmission side 
(i.e., the message is a bitmap), or when the overlay contains graphics. 

In order to allow accounting of the actual viewed material, the STB needs to keep 
track of the personalized content that has been shown to the viewer. For tiiis reason, the 

20 personalization engine typically keeps track of the paths chosen through the personalized 
content. This information can be transferred to a central server in some way. Unless this is 
done through a permanent connection, the information is stored on the STB between two 
accounting reporting moments. There are several options for this storage, including storage 
in RAM, NVRAM or physical media, etc. 

25 If the STB has a hard drive, that can be used for non- volatile storage of the 

accounting information. The amount of information is very small, compared to video 
storage, so the capacity of a typical hard drive will be sufficient for long-term storage. 

Another option is Smart Card storage. Storing the accounting information on a 
Smart Card allows physical retrieval of the information. The Smart Card could also be used 

30 to store the user profile information. The update of tlie user profile on the Smart Card could 
be done at the same time as the retrieval of accounting information firom the Smart Card. 
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The amount of storage available depends on the Smart Card and should be enough for 
accountmg purposes. One problem with this solution might be that a Conditional Access 
Smart Card, which cannot be used for the purpose of accounting, occupies the available 
Smart Card slot. 

5 Details for options for distribution of the user profile information to the STBs will 

now be presented. While typically one option is chosen for a specific network, each network 
may need to choose a different option because of differences in STB capabiUties. 

One option is Broadcast carousel, since there will probably be a significant amount 
of bandwidth available between the customization slots, that bandwidth can be used to 

1 0 distribute the user profiles to the receivers. The user profiles are transmitted cyclically in a 
database distribution carousel that carries the User Profiles of all receivers on that part of the 
network. In a cable network this is possible, since the number of users is limited. In a 
satellite network the amount of information may be so big that the repeat rate would become 
too low. If the repeat rate is high enough, there may not be any need to store the profile in 

1 5 non-volatile memory in the STB . 

Another option is overnight broadcast carousel. If the available bandwidth during 
peak hours is not high enough, the broadcast of the profile carousel can be moved to a low 
traffic time, if that is available. It can also be moved to a separate transport stream, and the 
STB can tune to that automatically if the user was not using it. This method may require 

20 non-volatile storage of the User Profile on the STB. 

Another option is a permanent direct connection. Since an STB with personalization 
capabilities needs some way to retrieve the accoimting information about the personalized 
TV content, there may be some form of communication with the server. This may be a cable 
modem with a permanent connection to the head-end. If that is the case, the STB can 

25 request the User Profile when necessary, and the server could signal the STB of an update in 
the profile. In this situation, there is no need for non-volatile storage of the User Profile in 
the STB. 

Similar to fiilltime direct connection, is direct dialup cormection. The connection 
needs to be estabHshed each time it is needed. This means tiiat there is no reliable way for 
30 the server to signal the STB of an update in the profile. It also means that the profile must 
probably be cached in non-volatile memory on the STB. It is acceptable to have the STB 
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dial-in every time it is powered on, or at least once a day to receive tibie latest profile. That 
way non- volatile storage would not be required. 

Finally, it is possible to transfer the user profile via physical distribution. This would 
likely be a form of smart card distribution. Physical distribution does not allow frequent 
5 updates of the user profile, but it does allow the system to work, even when no other 

conmiunication channel was available. The Smart Card is also used for accounting, and may 
include some incentive to get the users to return the smart card. This method could be used 
for small-scale trial runs. 

Although the present invention is described with embodiments specific to MPEG-2, 
10 the present invention may be used by any type of data transmission system, including 

analog and digital broadcasting, cable, cellular, satellite and teixestrial broadcasts, Video on 
Demand, Digital Versatile Disc (DVD), Internet, internet streaming video, ethemet, 
wireless, ATM, MPEG (including MPEG 1, 2, 4 and variations thereof), ACS etc. 

Although the invention has been shown and described with respect to illustrative 
1 5 embodiments thereof, various other changes, omissions and additions in the form and detail 
thereof may be made therein without departing from the spirit and scope of the invention. 

What is claimed is: 
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CLAIMS 

1 . A method for allowing the creation of a plurality of personalized messages 
5 comprising: 

creating a personalized message template comprising a plurality of slots in sequence, 
wherein at least one of said slots can include one of a plurality of different segments, with 
all segments for a particular slot being a same length; 

providmg a plurality of data streams to a receiving unit, each data stream delivering 
1 0 a different one of said plurality of segments for said at least one slots, wherein said 
segments are synchronized to begin and end at substantially the same time; 

providing content selection information regarding content of said plurality of data 
streams to said receiving unit, said information including switch times for said plurality of 
synchronized segments, to allow said receiving unit to select among said plurality of data 
1 5 streams for one of said segments for said particular slot, to assemble a personalized 
message. 

2. The method of claim 1 wherein said receiving unit selects among said plurality of 
data streams in real time. 

20 

3. The method of claim 1 wherein said personalized message is viewed by a viewer as 
it is assembled. 

4. The method of claim 1 wherein said receiving unit selects among said plurality of 
25 data streams based on said content selection information and information about a viewer 

who will view said personalized message. 

5. The method of claim 4 further including providing a data stream with a default 
personalized message to allow said receiving unit to display said default personalized 

30 message without selecting between said plurality of data streams. 
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6. The method of claim 1 wherein said plurality of data streams are MPEG encoded 
data streams. 

5 

7. The method of claim 1 wherein said plurality of data streams are multiplexed into a 

transport stream. 

8. The method of claim 1 wherein said segments are incomplete parts of a personalized 
10 message. 

9. The method of claim 1 wherem said receiving unit is a set top box. 

1 0. The method of claim 9 wherein said set top box can receive both analog data streams 
1 5 and digital data streams, and wherein said set top box momentarily switches from an analog 

data stream to a digital data stream to play out a personalized message. 

1 1 . The method of claim 10 wherein said set top box switches from an analog data 
stream to a digital data stream triggered by VBI data. 

20 

12. The method of claim 9 wherein said set top box momentarily switches from a first 
digital data stream to a second digital data stream to play out a personalized message. 

1 3 . The method of claim 9 wherein said set top box receives a pluraHty of television 
25 channels over said data streams, and said channels include programs including a 

synchronized commercial break; and 

during said synchronized commercial break; said data streams deliver segments to 
create a personalized message for display irrespective of which channel said set top box had 
selected. 
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14. The method of claim 1 further including transition segments, which are inserted into 
said personalized message between said segments. 

5 

15. The method of claim 1 further including a plurality of templates for creating said 
personalized messages, wherein said templates include video sequence templates and audio 
sequence templates. 

10 16. A system for distributuig a plurality ofmultimedia personalized messages to a 
plurality of end users, said system comprising: 

a personalized message template comprising a plurality of slots in sequence; 
a plurality of media segments for said slots, wherein at least one of said slots can 
include one of a plurality of different media segments, with all media segments for a 
1 5 particular slot being a same length; 

a plurality of data streams transmittiug said media segments, wherein said plurality 
of data streams transmit all media segments for one of said slots in at a same time, and 
wherem one of said data streams transmits content selection information regarding content 
of said pluraUty of data streams said information including switch times for allowing a 
20 receiving unit to switch among said plurality of data streams to select a particular media 
segment at a particular time, to assemble said personalized message. 

17. The system of Claim 16, wherein said receiving unit switches between analog data 
streams and digital data streams to assemble said personalized message. 

25 

1 8 . The system of Claim 1 6 wherein said receiving unit switches between a jQrst digital 
data stream to at least one second digital data stream to assemble said personaUzed message. 
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19. A system for distributing a plurality of multimedia pereonaUzed messages to a 
plurality of end viewers, said system comprising: 

a means for creating a pesrsonalized message template with plurality of slots; 
5 a means for creating a plurality of media segments, said media segments for use in 

said slots; 

a transmission means for transmitting said media segments, wherein said media 
segments for a particular slot in said personalized message are transmitted at a same time; 
a means for providing content information to allow a receiving unit to select one of 
1 0 said media segments at a particular time, to assemble said personalized message. 



20. A method for delivering a plurahty of different messages over a television 
transmission network, comprising: 

creating a plurality of different media segments, wherein said different media 
15 segments include incomplete sections of a complete message, and wherein at least one 
subset of said media segments are a same length; 

transmitting said plurality of different media segments to a television signal receiver, 
wherein all media segments in said at least one subset are transmitted simultaneously; 

directing said television signal receiver to switch to one of said media segments in 
20 said subset as said media segments in said subset are received. 
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21. A method for delivering a plurality of different messages over a television 
transmission network, comprising; 

creating a plurality of different media segments, wherein said different media 
5 segments include incomplete sections of a complete message, and wherein at least one 
subset of said media segments are a same length; 

transmitting a plurality of television programs to a television signal receiver, 
wherein said pluraUty of television programs have at least one synchronized commercial 
break; 

1 0 during said synchronized commercial break, transmitting said pluraHty of different 

media segments to said television signal receiver, wherein all media segments in said at 

least one subset are transmitted simultaneously; 

directing said television signal receiver to switch to one of said media segments in 

said subset as said media segments in said subset are received; and 
15 wherein after said synchronized commercial break, said television signal receiver 

switches to a previously selected television program. 
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SYSTEM AND METHOD FOR PERSONALIZED 
MESSAGE CREATION AND DELIVERY 



10 FIELD OF THE INVENTION 

This invention is directed towards video and media creation, and more particularly 
towards a system for creating individualized messages based on user information. 

BACKGROUND OF THE INVENTION 

1 5 Marketers have come to rely on demographic solutions to establish patterns and 

trends about the purchasing habits of their customers and how these habits relate to media 
pui'chases, demographics, and other factors. Alongside companys' proprietary databases, 
third party data warehouses have evolved, fashioned by many companies who share 
information either about specific customers or about data extracted from their customer 

20 bases. In both cases, advertisers use the derived information to generate observations 

relating to their markets, target individuals to different types of offerings and select 
appropriate media purchases for advertising. 

In the case of video advertising media, e.g., video tapes that are mailed, internet 
video streams, or broadcast or cable advertising ~ there are only limited means to produce 

25 personalized versions of the advertisements or direct marketing information that directly 

takes advantage of the information available about consumers purchasing habits and the 
like. Mostly, this reflects the nature of the traditional delivery media for video, which, 
until very recently, provided very limited capability to deliver anything more than a 
common message. As such, even though companies laiow a tremendous amount of 

30 information about their customers, the ability to leverage this information has been 

limited by the fimdamentals of the broadcast medium, requiring a like message to be sent 
to all customers. Additionally, the nature of video production, focused typically on one 
product, does not allow for incremental content changes. This forces advertisers to avoid 
topically relevant information and offerings. 

35 An early attempt to merge the power of real-time television with the information 

content of the Intemet is disclosed in U.S. Pat. No. 5,778,181, Hidaiy, et. al., dated July 
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7, 1998 (the 181 patent), in which a user is presented with a video along with related 
Internet information, A user has a personal computer connected to two signal paths: a 
video signal and a second separate connection to the Internet for receiving Internet 
information. To use the described system, the video producer needs to fnst create the 
5 video, encode the Internet addresses (or URLs) of web pages, and then distribute the 

composite information. A limited portion of the vertical blanldng interval (VBI) of the 
video signal is encoded to deliver the URLs. The client software retrieves and decodes 
URLs from the video program. These URLs are interpreted, and direct the web browser 
software to retrieve web pages. The web pages are synchronized to the video content for 

1 0 display. Alternatively, the encoded video signal could be simultaneously routed to a 

specialized server that decodes the URLs, contacts the addressed Internet server, and 
directs the server to send the designated web pages via the Internet to the user's PC where 
they are then displayed. Among the disadvantages of the system such as described, is 
that the video and corresponding web content are static and defined by the video producer 

15 during production. The same URLs are sent to every viewer of the same video. There is 

no change to the content of the video according to any reai-time understanding of the 
viewer. Similarly, no mechanism is described for changing the content of the web pages 
in real time either, even if the server somehow obtained information about the preferences 
of the viewer. 

20 A somewhat selective system is described in Abecassis, U.S. Pat. No. 5,71 7,8 14, 

issued Feb. 10, 1998. The system in the *814 patent includes a capability for a more 
individualized control over the contents of a requested video program. Segments, or 
clips, of a video scene are first evaluated and rated according to criteria such as the 
amount of violence, nudity, or profanity, as well as other criteria related to otiier elements 

25 of the clip (location, time, detml, etc.). Each clip is associated with a record containing 

keywords related to the subject matter, such as "flag burning," that a user may prefer not 
to see. A series of clips (a "program") is then mapped into a series that constitutes the 
presentation when viewed in sequence. During run-time, the actual series of clips shown 
are selected from the library of clips according to the user's preferences. Thus, a viewer 

30 might decide to watch a condensed version of a movie without any gore while another 

viewer may prefer a lengthier version with gore but not profanity. A producer and 
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director can also create multiple versions of important scenes that will be viewed 
according to the viewer's preferences. As the price of such user-selection, this system not 
only requires the producers initially to rate, key, and map each segment in a movie 
according to the various parameters, but also requires a specialized viewing system that 
5 can translate the viewer' s preferences into the proper selection and mapping criteria for 

properly sequencing the optional segments during the playback. For example, a 
specialized laser-disk unit would be programmed to play a specially encoded disk 
according to the viewer's desires, In a wideband network context, the transmission 
system would first upload user preferences, omit non-conforming clips, and create the 

1 0 resulting download movie. In any case, the result is a pre-selected set of clips, as a 

function of the user preferences, that will be played in sequence for the viewer. The 
creation and inclusion of clips in the program must necessarily precede consideration of 
the user's preferences. The viewer is not really interacting with the producers, but only 
the machine making the selection of pre-selected clips. No "new" materials are selected 

1 5 or incorporated into the show during viewing - only "old" materials that have been pulled 

together as a function of the user's selected preference. Thus, nothing is "created" 
specifically for the viewer. 

A somewhat more interactive solution is described in Freeman, U.S. Pat. No. 
5,861,881, issued Jan. 19, 1999, in which a user interacts with a computer to determine 

20 which of several cable TV or other audio-visual inputs will be displayed on the screen at 

any given time. Stored user commands determine which of the multiplexed signals will 
be selected, and specialized hardware "seamlessly" switches between video channels, 
such that the user camiot perceive the switchover (other than the change of content). For 
example, at the start of a sports program, the user can select the prefen-ed language of the 

25 audio segments, and whether on-screen graphics (e.g., player statistics) should be 

displayed. These inputs can be used to insert scheduled "trigger points" into the video or 
digital program which are later used to select the audio-visual combinations preferred 
according to inputs by the user. When a trigger point is played, the computer system 
selects a different video segment, graphic, or audio segment, either from alternate 

30 channels, or &om a database of such segments downloaded to the computer on a second 

communication channel (either in parallel with the primary transmission, or on CD-ROM, 
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or at some oflier time). As with other versions of this approach, the user must 
intentionally interact with the program to select the preferences. Also, the only selectable 
segments are those produced as part of llie program. TTiere is no real-time search for or 
compilation of new materials. The user preferences are only evaluated according to the 
pre-selected criteria that correspond to segment selections. Each video segment is either 
played or not played; but the video segment itself is not modified according to any user 
inputs. 

The television industry's reaction to the limitations of broadcast medium has been 
"localism," that is, an attempt to target audiences by demographic, geographic and 
psychographic means. Localism reflects market generalizations, often derived from 
actual profiles and data. Localism is offered in the broadcast forum by buying 
placements in geographic areas. On cable this can be a neighborhood. On specific 
television shows it can be via reflecting certain viewer preferences according to 
demographics, or times of day. The results have left advertisers, who pay by the 
"eyeball," dissatisfied with the expediency of their advertising dollars. The cable 
television mdustry, in an attempt to respond to these shortcomings and to distinguish its 
offering firom broadcast, is deploying addressable advertising systems which allow 
advertisers to purchase individual households or even single set-top boxes for their ads, 
allowing, when combined with household profiles, an extremely fine grain of targeting to 
reach the appropriate viewers. 

This form of targeted or addressable advertising, is similar to the capabilities now 
found on some Internet services, where single viewers based on then: profiles can be 
targeted with banner ads and interstitials or email. At the same time, Internet advertising 
is increasing its use of rich media (defined as 20-Kbytes/sec or above), in an attempt to 
create the type of powerful and effective images we associated with television 
advertising. Sometimes because of bandwidth limitations and often because of a 
mistaken philosophy, these ads necessitate consumer interactions. The result, in contrast 
to television advertising, forces the consumer to interact, distorting the media's capability 
to deliver a message. 

As a means to improve on targeting, designers of Web based offerings began to 
employ personalization solutions. On the Internet, where many traditional factors 
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associated witii purchasing decisions become less relevant, the ability to establish a one 
to one relationship with a consumer is paramount. Similarly, it is most desirable to oJBfer, 
if possible, service and products reflecting that one-on-one relationship. To cite an 
example, Dell Computer allowed customers to build their own computers (mass 
customization) on the Web, instead of pre-building several different models for different 
target mai-kets (targeting). Dell and other companies employed sophisticated customer 
relationship management (CRM) solutions based on general and proprietary technologies. 

These CRM solutions, based on a variety of existing technologies, personalize 
offerings by using a combination of information gathered from the consumers visiting 
web sites. Such information is typically gathered by asking questions, tracking 
navigation and purchasing behavior, as well as from information gathered elsewhere. 

Yet another step in the enhancement of advertising has been taken recently, as 
reported in the press. For example. Enliven of Waltham, MA, offers real-time, database 
connection capabilities that let advertisers present up-to-the-minute information in 
Enliven-activated ads. Advertisers can present live information from a database source to 
a consumer viewing the ad with a proprietary, Java-based viewer. When merged with a 
marketing database such as TrueMatch, profile-based ad campaign targeting becomes 
possible. An advertiser creates a template into which graphics and text are inserted, 
according to the demographic information available about the user. However, even with 
the additional consideration of demographic information for real-time selection of 
advertising components, the templates provide a limited capability to effect enhanced 
advertising. This known system does not include any capability to modify or incorporate 
video materials into the advertisements, thus depriving the advertisers of the rich menu of 
video-oriented raw materials from which to draw. This leaves the viewer with little more 
than an mteractive banner ad, perhaps with primitive "effects" that happens to have been 
"tailored" for publication to that user. There is no capability to change the tempo, music, 
narration, lighting, or any other elements of the advertising that have been proven 
successful in gaining the viewer attention the advertisers desire. 

Further, even with known interactive personalization solutions in place, text and 
graphics solutions cannot compete with, the masterful ability of video and audio to 
generate mterest, create brand awareness, or product unage. Television advertising 
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agencies are master storytellers, using the types of narrative that people respond to so 
well. Although the Internet is a powerfiil medium on which to personalize dynamic 
offerings it lacks the power of traditional television which uses the richest of media to 
present powerful 30-second stories. The Internet is, by form, an interactive media, with 
5 the user typically controlling the type of message received. If the user can control the 

media message, eitiier through explicit commands about what type of information the 
user reveals, or alternatively what information tib.e user receives, the power of narrative 
story telling to a passive and receptive audience is lost. 



10 SUMMARY OF THE INVENTION 

The present invention is directed towards a system and method for dynamically 
creating individualized, multi-media messages for delivery to an intended audience, 
which can be specific groups or individuals. A message, story, or advertisement is 
assembled on demand, based upon rules applied to each user's profile data and the 

1 5 available library of media segments. The narrative framework for the final personalized 

message is a story as defined by a message campaign. The message campaign includes a 
message template and a collection of media segments. The media segments are selected 
and then assembled to produce the final personalized message at assembly time. Specific 
media segments are selected and merged according to the message template and 

20 information about the viewer derived from a user profile. The information from the user 

profile is interpreted by an expert rule system to determine which of several potential 
media segments to select for use in the personalized message. The merged composite is 
then encoded to match the distribution media and forwarded to the user for viewing. 

Although the operation of the present invention includes the ability to assemble 

25 and convey a message upon demand, an advantage is the ability to match the presentation 

options with an educated and timely assessment of the target audience according to a 
number of templates. A campaign plan defines what Ihe target group is (entity 
qualification), and what individual viewer information is relevant (entity profile) for 
target entities within the target group. Additional factors include the selection of input 

30 databases, target distribution chaimels, and environmental factors (weather, current 

interest rates, etc.). A message resource library contains the collection of video, audio. 
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and other elements necessary to assemble the whole range of different messages based 
upon the message template. Message library resources include not only the varied clips 
necessary for each selection point of the template, but also variations triggered by 
changes in the monitored environmental factors, as well as synthesized speech and visual 
5 constructs to meet individual profile requirements. 

Assembly of the message according to the present invention is based upon a 
message template which embodies the rules for selection and combination of the most 
current message library resources according to the entity profile at the scheduled time of 
message production. The present invention allows automated dynamic message assembly 
10 at any point up to seconds before delivery, based upon entity and environmental factors 

that are in constant flux, yet combined in a manner that addresses the communicative 
objectives of the campaign, A master task scheduler is defined according to the 
campaign requirements to control and coordinate all activities of the creation of the 
viewer profiles, message resource library, and message assembly. 
1 5 The present invention includes the ability to edit and use scene or segment 

substitutions, choice of narrators and language, music changes or substitutions, audio 
effects, text and graphic overlays, speed changes, background changes, word or phrase 
insertions, more complex story changes, utilization of video libraries, digital video effects 
(DVE's) and transitions, and seamless synthetic voices, characters, and studio sets. Many 
20 of these scenes or segments may also be modified at message assembly time according to 

the selected environmental inputs, or interpretation of individual viewer inputs. 

Advantages of the present invention include message creation upon order, not by 
forecast, with story-driven message assembly tailored to the individual and any 
combination of information known about the target viewer and the present enviroimient. 
25 A new marketing paradigm is created, with the focus on differentiating customers, not 

just products. This in turn creates new opportunities for increasing customer interest, 
satisfaction, and retention of the campaign message. 

Other advantages include the automated real-time creation of the message, which 
solves problems of timeliness and personal privacy. Computers, not humans compose the 
30 final form of the ad from the raw materials and previously generated templates. 

Other advantages of the present invention include a system and method for 
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gathering user profile information from a variety of different sources and databases, and 
processing the user profile information by a profiler which uses rules of assembly for 
creating a format usable by the message creation system. 

Other advantages of the present invention include a system for creating templates 
with multiple insertable media features to create a personalized message for an individual 
or group. The number or type of insertable media features is not limited. For example, 
every element of a television commercial may be selected (or dynamically created) to fill 
in a template, including background view (such as a city slcyline, and seasonal choices as 
well), music (background and jingles), language and accent of narrative, the choice of 
what narrative to add, the product being shown (for example a car or truck), the 
appearance of the product (for example the color of a car or accessorizations), selectable 
video of real actors, the length the commercial runs, any screen over text, etc. The media 
segments may all be created with the initial template, or created afterwards, including 
new media segments based on current events, but which are used in a template which has 
been in use for some time. 

Another advantage is an expert rule base which allows the selection of proper 
media features for an individual, based on collected information about the individual. 
The expert rule base is able to use incomplete data or knowledge to make appropriate 
decisions about selecting media segments for an individual. The expert rule base can also 
malce inferences about an individual based on available data. 

Yet another advantage of the present invention is a highly flexible delivery system 
and method. The media messages may be assembled at any time during the process, 
anywhere from the time the message template and media segments are created, or up to 
and including real-time delivery where the media message is created and shown to the 
individual. Further the media message may be created at many different places, both 
centralized and decentralized, from the studio, to local station or web site, on a satellite, 
at a syndication station, at a cable television central office, neighborhood network, or 
even by a satellite receiver or cable box inside a viewer's home. Still further, the choice 
of delivery mediums is extremely varied, from prerecorded video tapes, DVDs, CDs etc. 
which are sent to an individual, to live feed through a cable system, intemet connections, 
satellite link, RF towers, line RP signals, cell phones etc. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other features and advantages of the present invention will be 
more fully understood from the following detailed description of illustrative 
embodiments, taken in conjunction with the accompanying drawings in which: 

Fig. 1 is a block diagram of a system according to the present invention; 

Fig, 2 is a flow chart showing an overview of timing of media creation according 
to the present invention; 

Fig. 3 is an overview of assembly of components to produce a media message 
according to one embodiment of the present invention; 

Fig. 4 is a more detailed diagram of assembly of components as overviewed in 

Fig. 3; 

Fig. 5 is a block flow diagram of an illustrative embodiment of a system 
according to the present invention; 

Fig. 6 provides details of an example message template according to the 
illustrative embodiment of Fig. 5; 

Fig. 7 provides details of an example message resource library associated with the 
message template of Fig. 6; 

Fig. 8 illustrates assembly of a message according to example rules applied to the 
components of Figs. 6 and 7; 

Fig. 9 is a block diagram of an embodiment of the present invention for 
personalized message delivery over an internet system; and 

Fig. 10 is a block diagram providing more details of the embodiment of Fig. 9. 

DETAILED DESCRIPTION 
A system 20 for personal message creation and delivery according to the present 
invention is shown in Fig. 1. A user profile database 22 includes information regarding an 
individual 24. This user profile database 22 can be in any form, including a proprietary 
database of information owned by one entity, or publicly available information at one or 
at multiple locations, including information from user interactions on web sites or 
shopping networks. For example, tiie database may be a subscriber database accessed by 
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the system 20 on a per-transaction system. The user profile database may contain any 
type of information regarding the individual 24, including demographics, address, 
monetary income, political affiliations, known preferences, buying patterns etc. 

A template database 35 includes message templates which reflects the story, or 
message that the message creator or provider desires to convey to the audience. This 
message is described in terms of a "campaign", in that the message may be any type of 
message from a product advertisement, to a political message or informative message 
which may be tailored for each individual or group receiver. Details regarding the 
creation of a campaign will be described below. 

One or more libraries or databases 26 include media segments which are used to 
assemble the personalized message. The databases 26 include a compendium of elements 
that may be broadly categorized as graphics 28, video and sound segments 30, and 
animation 32. These media segments may be part of a general library of available 
material, for example pictures of individual city skylines, attractions, or natural scenery 
for use in backgrounds. Alternatively, media segments may be generally or specifically 
created for a certain messajge campaign. For example, in an automobile advertisement, 
several media segments showing a certain automobile model in different colors may be 
provided, which are to be inserted into a media template from the template database 35 at 
an appropriate location. Which media segment is selected for insertion depends on user 
24 information, together with the media template specifications, as will be discussed 
below. 

Similarly, the database for video and sound 30 and animation 32 may include both 
"stock footage" which are available as needed by any message campaign; and specific 
message campaign material created and stored for a particular campaign. Animation 
includes any type of animation such as cartoon characters and logos etc. 

In addition to the resource library, the system according to the present invention is 
able to synthesize additional elements 34 as needed during message creation, thereby 
providing increased flexibility. Such synthesized elements include sound such as 
synthesized speech, music, background sounds, and graphics such as text, background 
filler, visual objects (including color variations thereof), and visual effects (including 
dissolves, morphuig of objects, etc.). 
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The personalized messages are assembled by an assembly system 36. The 
assembly system receives a message template from the template database 35, and uses 
media segments from the databases 26 to put together the message. The assembly system 
36 receives input on the user 24 from the user profile database 22, and also receives input 
5 from expert rules 3 8, which interpret the user profile data, and direct the assembly system 

36 to select which particular segments from the databases 26 to combine for the 
personalized media message. The expert rules 38 system is capable of interpreting user 
profile data from many different sources and in many different formats. The expert rules 
38 system is also capable of making decisions based on incomplete user profile data, 

10 providing logical "fallback" selections as necessary. The expert rules 38 system will be 

described in detail below. 

The assembled personalized message is encoded for a delivery medium 40, and 
then delivered to the individual viewer 24, typically by a display device 42, which can be 
any of various types of receiver including television, computer monitor, radio, phone etc. 

1 5 The delivery medium can be any of various types of media, including prerecorded video 

tapes, DVDs, CDs etc. which are sent to an individual, or live feed through a cable 
system, internet connections, satellite link, RF towers, line RF signals, cell phones and 
the like. As the present invention facilitates real-time creation, personalized messages to 
individuals may be delivered in many different ways, based on the user profile. For 

20 example, an individual 24 with a satellite connection would receive a distribution in a 

fonnat different from another individual 24 receiving a media message for the same 
campaign, but delivered by the internet. More detail regardmg the delivery medium 40 
will be provided below. 

A campaign message process according to the present invention are outlined in 

25 Fig. 2. Campaign message programs are divided in three basic stages: message creation 

time 50, assembly time 58, and delivery time 64. During the campaign creation time 50, 
the producers define and create the message templates 56 and also create or select media 
segments 54 the system will need for generation of 1h.e personalized messages or 
advertisements, step 52. The message template 56 is the fimnework which holds the 

30 story together. Results of the creation step are stored in the template database 35 and the 

message resource library 26 as a set of message templates 56 and media segments 54, 
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At message assembly time 58, the present invention uses information from the 
user profile 60, message template 56 and media segments 54 to create the personalized 
message for the specific user 24, step 62. The system uses expert rules 38 to assist in the 

process. 

5 The next step is message delivery time 64, where the peraonalized message is 

presented to the user 24. This presentation may involve transmitting tlie message, or 
placing the message on some type of media. As previously described, message creation 
time 58 and message deliveiy time 64 may be contemporaneous, in that the message is 
created on the fly, or "just in time". 

10 Fig. 3 illustrates an embodiment of the invention in which substitution editing is 

implemented. A producer or editor working at an editing station 70 creates a message 
template 56 comprised of descriptions of different types of multi-media materials such as 
video, graphics, music and narration. The editor also creates or selects the media 
segments and consolidates them in the selected storage or database 54. User profiles 60 

1 5 about the user 24 are obtained and fed to a rules system 38 for substitution editing. The 

rules system then selects raw materials firom the media segments database 54 according to 
the message template 56 and user profile 60 and combines them to form a completed 
personalized message 72 that is delivered to the viewer 24. 

Fig. 4 provides a more detailed view of the assembly stage according to an 

20 embodiment of the present invention for rules based substitution editing. A message 

template 56 is obtained from the message template database 35. The message template 
56 describes a framework to create and complete a personalized message 72 for the 
selected individual 24. The message template 56 runs for a certain length of time, as 
shown by arrow 76. The final running time of the personalized message may vary, as 

25 according to the present invention, the message can be diversified on many levels, 

including short messages or very long messages, as appropriate for the individual 24, 

The message template 56 may mclude both predefined sequences 78 and 
insertable sequences 80. Predefined sequences 78 are media segments which are 
common to all fimal personalized messages 72, in that they do not vary based on the 

30 individual 24. In the example message template 56, the first sequence 78 is a predefmed 

sequence. In this presented embodiment, the predefined sequences are stored m the 
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media segment database 26, and inserted at the appropriate locations in the message 
template 56, The predefined sequences 78 only differ in the same predefined sequence 78 
is always selected for that location in the personalized message. Alternatively, the 
predefined sequences may be stored or linked directly into the appropriate location in the 
5 message template 56. 

The other sequences are insertable sequences 80, which are filled in as directed 
by the rule system 38. The rule system 38 receives information from the template 
database 35 regarding the message template 56 being assembled, and also receives user 
profile information 22. The rule system then determines the appropriate media segments 

10 to insert into the insertable sequences 80 of the message template 56. For example, the 

first insertable sequence 80a is video selected from the video and soimd database 30. A 
next insertable sequence 80b is also selected from the video and sound database 30. 
Continuing with the present example, a predefined sequence 78 is then followed by an 
insertable sequence 80c comprising animation fi-om animation database 32. The next 

1 5 insertable sequence 80d is another video segment from the video and sound database 30, 

followed by a final insertable sequence from the animation database 32. 

Also the predefined sequences 78 and insertable sequences 80 are shown in the 
present example with no overlap, however the present invention is not limited to 
orthogonal assembling of media segments. All elements of the personalized message can 

20 be controlled, and combined in various forms to provide powerful customization. For 

example, a backgroimd scene 86 such as a geographic landscape, is selected from the 
video and sound database 30 and used as a common background for the predefined 
segments 78 while insertable segments 80 are added to the message template 56. The 
backgroimd scene 86 is not used for the end of the personalized message, in that the 

25 insertable sequences 80d and 80e do not use a background (or already have a 

background). In similar techniques, various physical elements may be inserted into 
standard video, for example the video and sound database 30 can include footage of 
several different actors providing dialog for a message, and the rule system 38 selects 
footage of a certain actor based on information firom the user profile 22. The selected 

30 actor footage is tiaen added as foreground in an insertable sequence 80. In this way, every 

element of a personalized message can be customized. 



13 



wo umii6 



PCT/USOl/10351 



Additional elements such as music 84 can be added to the personalized message 
as appropriate. In the present example, music 84 is supplied for the end of the 
personalized message. The rule system 38 selects among the choices of music provided 
for insertion into the message template 56, and music is added from the video and sound 
5 database 30. 

Another element provided for the message template 56 is narration 82, which for 
the'present example is synthesized voice 34 which is created dynamically as needed. 
Alternatively, prerecorded speech can be used, including multiple selections of 
prerecorded speech, which is selected according to criteria processed by the rule system 
10 38. For example, prerecorded speech may be in different languages, or with regional 

accents, allowing the present invention to customize the message with different rich 
media features for the message creation. 

Fig. 5 shows an illustrative embodiment in which additional features of the 
invention are described, with details of the process of creating a campaign. Prior to the 
1 5 creation of a message or advertisement, a client works with the system operators to 

determine a formalized campaign plan 100 to be executed. The campaign plan is used by 
the client to define the communications task the client wishes to accomplish and, in turn, 
it drives all of the processes necessary to achieve the program. 

The first step is to create rich media video composition example or examples of 
20 the message that the client wishes to deliver to the audience. Typically it will be of the 

prescribed time duration and exhibit one complete message as an example of one specific 
version of the intended communication. This provides the starting point for later 
construction of a message template or templates 56, Fig. 2 and a resource library (media 
segments 54) from which the various personalized versions of this message are 
25 assembled. 

The next step involves target entity qualification data fectors 104 Fig. 5. The 
client delineates the general characteristics of the members of the audience to which the 
message is to be delivered. It may include, for instance, appropriate media connection, 
family status, financial category, age grouping, regional location, etc. This information is 
30 used in the database searches to acquire the list of individuals or entities to which the 

message will be distributed. 
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The next step involves search databases selection 106, and allows the client to 
define the limits of the search by identifying the databases 200 which are to be searched 
for data input. The entity profile database itself can be an input source built up 
interactively with the target entity. 
5 The next step uivolves creating an entity profile template 1 08. The entity profile 

template 108 is a complete or partial definition of the information about each individual 
or entity that is to be acquired by the search as well as a pattern for the formatting of this 
data. It is used in the generation of the target entities profiles and status database which 
not only governs the resources and rules used to assemble each personalized message, but 
1 0 also is the repository for all of the interactive information received from the target user 

24. 

The next step, called distribution channels selection 1 10, is defined by the 
campaign. It allows the client to decide what media outlet or outlet priority he wishes to 
use to communicate with his target audience. 
1 5 The next step is the definition of the delivery window specifications 112. These 

specifications define a tune duration over which the campaign will be executed as well as 
if special time and/or programmatic related conditions are required. This uiformation is 
the starting point for generating a master task schedule 118. 

The next section involves interactive query response 1 14, whish is used to define 
20 any interactive transactions that may be utilized by the campaign such as acquiring 

additional information about the target entity, polling responses, purchase transactions, 
etc. 

The next section involves enviroimient status factors 116 and refers to 
establishing a description for existing environmental factors, for example weather, current 
25 interest rates, current travel fares, etc. that need to be updated at the time the message is 

transmitted to enhance the timeliness and relevance of the personalized communication 
packets. 

The final section involves verification transaction financial factors 118, and is 
used to define all of the financial factors such as verification, billing, purchase 
30 transactions, etc. which must be monitored 201 and recorded 502. Also any actions to be 

taken as a result of this information are indicated in this section 118. At this point, the 
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client's work in configuring a campaign plan 100 is completed, 

The next set of actions are directed towards preliminary service activities. The 
first step 204 in this process is to assemble the target entities profiles and status database 
503. This is the working database for this illustrative embodiment. It relies on the 
5 database selector 200 which is driven by the campaign plan 100 to determine which 

databases 200 to search. This database 503 should be completed before any of the other 
activities may proceed since the information it contains is used by the other activities to 
complete their tasks. It may, however, be updated at a later time by the ongoing service 
activities including the query response tasks. The search is set up utilizing the target 

1 0 entity qualification factors 1 04 to decide which data records to retrieve and the entity 

profile template 108 to select and format the data for each individual or entity. It reserves 
fields for whatever polling, verification, transaction, or fmancial etc. information is 
required. This database 503 is the repository for all of the mformation generated by this 
embodiment about the target entities. 

1 5 The next step 208 to be defined is the management of the query and response 

interface with the target entity. When present, this activity allows two way 
communication on a limited basis with the individual 24 who receives the message. It 
typically requires special capability embedded in the media distribution network. It also 
needs to be able to distinguish the identity of the sender and associate his responses with 

20 his data profile. Timing is coordinated by the Master Task Schedule 308. 

The process of determining the message template 400 is an important part of this 
embodiment. The template embodies the rules for assembling personalized messages 
utilizing the profiles data and the resource library 26 Fig. 1. An operations diagram for 
this activity will be described in reference to Fig. 6. It typically relies on the range and 

25 detail of the formatted profile information, the campaign plan example message, and the 

requirements for any query/response activity that is specified. 

Once the message template has been constructed, then a message resource library 
26 is created, step 300 Fig. 5. This resource libraiy 26 contains the alternate clips of video 
and audio needed to assemble the whole range of different messages. One sub-process 

30 304 has the instructions to receive environmental information, and synthesize the video 

and/or audio segments required by the message template for timely individualized 
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message assembly. Another sub-process 302 provides the ability to synthesize, on the fly, 
artificial speech and visual constructs to meet the individual specifications indicated by 
the different entity profiles. Obtaining and maintaining current environmental 
information is a separate parallel operation 306 that is constantly polling the appropriate 
information channels and making the acquired data available on demand to the unit 304 
that synthesizes tiiis status information for the resource library. This information can be 
obtained fi*om places such as the internet, the weather service, a news service, a private 
internet or intranet, etc. 

A next step 308 is to establish the master task schedule. The information gathered 
by the campaign plan 1 00 is formatted such that it outlines the process flow and 
coordination requirements for each step of the ongoing service project firom initiation to 
completion. This data is utilized to establish the master task schedule which controls and 
coordinates all of the activities and events as soon as its project "clock" is started. 

The next set of actions are directed towards service execution and delivery. After 
the preliminary service activities have been executed (except for timely updates) the 
schedule "clock" may be started. This controls the scheduled generation and delivery of 
the projects personalized messages to all of the profile entities in the target entities 
profiles & status data base 503. Execution is a continuous step and repeat process which 
can deliver on the fly or accumulate appropriate batches for sunultaneous delivery. Each 
step begins with the presentation of the next profile 206 to the assembly node 404 which 
uses this profile to select and assemble the correct material from the resource library into 
its "slot" in the appropriate selected message template. It then sends the assembled 
message on to the transcoding and/or compressing operation 406 which delivers a video 
stream that matches the specifications for the delivery media. These video messages are 
transported to tiie chosen media distribution center 212 for delivery at the scheduled time 
to the media user interface 214 which communicates with each appropriate target entity 
214. 

When creating the campaign plan, the campaign manager working with the client 
to encode a default message example 102. The example serves as a message template 
containing a rich media video composition of the message that the client wishes to deliver 
to his audience. The example is of the prescribed duration and exliibits one complete 
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advertising or oilier message as an example of one specific version of the intended 
communication to be delivered. This provides the starting point for later construction of 
a message template 400 and a resource library 300 from which the various personalized 
versions of the message are to be assembled. 
5 The client delineates the general characteristics of the members of the audience to 

which he wishes his communication to be delivered. It may include for example 
appropriate media connection criteria, family status, financial category, age group, 
regional location, etc. The resulting set of target entity qualification data factors 104 is 
used in database searches to acquire the list of individuals or entities to which the 

10 message will be distributed. Further criteria for search database selection 106 are also 

defined by the client 

An entity profile template 108 is also created as a complete definition of the 
information about each individual or entity that is to be acquired by the search as well as 
a pattern for the formatting of the retrieved data. This entity profile template 108 is also 

1 5 used in the generation of the target entities profiles and status database 204 which not 

only governs the resources and rules used to assemble each personalized message but also 
is the repository for all of the interactive information received fi*om the target entity. A 
distribution channel selection 110 defines itself. This selection allows the client to decide 
what media outlet or outlets he wishes to use to communicate with his target audience. 

20 Client campaign plans also define the delivery window specifications 1 12. These 

specifications define a time duration over which the campaign will be executed as well as 
when special time or programmatic related conditions are required. This information is 
tiie starting point for generating a Master schedule 308. 

Interactive query responses 1 14 are defined where the campaign desires to acqune 

25 additional information about the target entity, poling responses, purchase transactions, 

etc. The client can also define envuromnental status factors 1 16. These factors will need 
to be updated at the time the message is transmitted to enhance the timeliness and 
relevance of these personalized communications packets. Examples include the weather 
in various places, cun-ent interest rates, current travel fares fi-om place to place, etc. 

30 As a final preparation for operations, the client and system operators define all of 

the verification transaction financial factors 118 which must be monitored and recorded. 
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This element also includes definitions for any actions to be taken as a result of this 
information. 

Once the campaign plan has been encoded, a set of preliminary service activities 
takes place in preparation of the elements necessary for the dynamic customization phase. 
The first activity is to assemble target entities profiles and status database 204. This is 
the working database for the whole current dynamic customization system. It relies on 
the database selector 200 which is driven by the search database selection 106 to 
determine which databases to search. This database 204 must be completed before any of 
the other activities may proceed, since the information it contains is used by the otlier 
activities to complete their tasks. It may, however, be updated at a later time by the 
ongoing service activities including the query response tasks. The search is set up 
utilizing the target entity qualification factors 104 to decide which data records to retrieve 
and the entity profile template 108 to select and format the data for each individual or 
entity. It reserves the fields for whatever polling, verification, transaction, or financial 
information is required. This database is the repository for alt of the information 
generated by the system about the target entities. 

The next activity in preliminary services is the management of the query and 
response interface 208 with the target user 24. Wlaen present as part of the campaign, this 
activity allows two-way communication on a limited basis mth the individual who 
receives the message. Use of this feature may be implemented by the media distribution 
network, such as a set-top box interface, for example web TV. Preferably, the interface 
can distinguish the identity of the sender and associate his response with his data profile. 
The timing of any user interaction is coordinated by the master task schedule 308. 

The process of determining the message template 400 is described below. The 
message template 400 embodies the rules for assembling personalized messages utilizing 
the profiles data and the resource library. The message template process relies on the 
range and detail of the formatted profile information, the campaign plan example 
message, and the requirement for any specified query/response activity. 

Once a message template has been constructed 400, then a resource library must 
be created 300. This library contains the alternative clips of video and audio needed to 
assemble the whole range of different messages. One sub-process assembles the whole 
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range of different messages. Another sub-process receives environmental information 
306 and synthesizes 304 the video and audio segments required by the message template 
for timely individualized message assembly. Another sub-process will provide the ability 
to synthesize 302, on the fly, artificial speech and visual constructs to meet the individual 
specifications indicated by the different entity profiles. 

A separate process running in parallel obtains and maintains the enviromnental 
information 306 by constantly polling the appropriate information channels and making 
the acquired data available, on demand, to the synthesizer process 304 for the resource 
library 300. This information could be obtained from places such as the Internet, the 
weather service, a private intranet, local sensors, etc. 

The information gathered in the campaign plan 100 must be formatted such that it 
outlines the process flow and coordination requirements for each step of the ongoing 
service project from initiation to completion. This data will be used to establish the 
master task schedule 308 which controls and coordinates all of the activities and events as 
soon as the project "clock" is started. 

After the preliminary service activities have been executed (except for timely 
updates) the schedule "clock" is started. Tliis controls the scheduled generation and 
delivery of the dynamically customized advertisements to all of the profile entities in the 
target entities profiles and status database 204. Execution is a continuous process of "step 
and repeat" which can deliver messages on demand or else accumulate appropriate 
batches for simultaneous delivery. 

Each step begins with the presentation 206 of the next profile to the assembly 
node 404 which uses this profile to select and assemble the correct material from the 
resource library 300 into its "slot" in the message template 400. It then sends the 
assembled message on to the transcoding and compressing operation 406 which delivers 
a video sfream that matches the specifications for the delivery media. These video 
messages are then fransported to the chosen media distribution center 212 for delivery at 
the scheduled time to the media user interface 214 which communicates with each 
appropriate target user 24. The process is then repeated for the next profile 206 until all 
listed profiles are serviced. 

Fig. 6 illustrates a sample message template 56. The message template(s) 56 
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design is determined using infonnation from the default message example 102 Fig. 5 and 
the general criteria that defines the entity profile template 108 together with any 
interactive information relevant to tlie message. The range of values for each media 
segment derives initially from the information given in the campmgn plan 1 00 about the 
default message example 102 and its variations. Beyond tihat, the entity profile template 
108 establishes the breadth of information sought for each profile category such that it 
will provide adequate information to customize the desired segments for the chosen 
entity. In addition, some information can be derived from the interactive responses of the 
client entity as well as from the updated environment status information provided to the 
message resource library databases 26. The message template 56 Fig. 6 is the mold into 
which the proper selection of resources are "poured" to form the specific message for the 
specific entity whose profile has been presented for assembly. 

The message template or templates 56, together with the breadth of information 
established as previously described, forms the basis for generating the message resource 
library 26. Each defined media segment 54 for each video and audio track of the message 
template 56 requires at least one or more alternate segments 54 to be generated to provide 
the full range of variations reqmred to cover all of the profile categories and the variation 
in category types. Alternatively, the message resource library can be updated with new 
alternate segments 54 and the expert rules 38 updated to provide fmer granularity in 
customization based on feedback from initial use of the campaign. The expert rules 38 
according to the present invention allow for continuous tweaking of the message 
assembly. The message resource library also keeps updated information on any current 
environmental status information needed to assemble tlie messages. 

These video and audio segments will generally be stored on high capacity, high 
speed servers 200 Fig. 5, at the highest quality level needed by any of the target media 
through which the messages will be distributed. They are available to the assembly 
operation in "real time" for production "on the fly". Each segment 54 is sized to fit its 
template slot and have its own identity and time code location for rapid retrieval by the 
assembly operation. In another embodiment, alternative segments for one template slot 
can vary in length, and the system automatically adjusts the final message to properly fit 
in the total time slot. Typically this is performed by shortening a following segment. 
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which may be created to allow such variations in length. 

The next profile 60 of a user 24, Fig. 5 for whom the current message is being 
customized is pulled from the target entities profiles & status database 503 that contains 
all of the data collected to "fill" the profile template 60 Fig. 8 for each of the entities 
5 selected for the current campaign. This profile 60 need not be limited to passive 

accretion of facts but may include information derived by sophisticated behavior analyze 
of buying habits etc. Each profile 60 is presented to the assembly operation to be used as 
a basis for selecting the media segments 54 that are appropriate to this specific profile to 
be placed in each of the slots in the message template 56. 

1 0 The assembly operation 404 proceeds in a rudimentary fashion by selecting each 

media segment 54 fi-om its alternates by simply locating tlie segment in each category 
that includes the profile's value for that category and using the defeult segment when no 
information is available for that slot, as shown in Fig. 8. Alternatively, a more powerful 
form of selection is used based on a logical rules to evaluate several pieces of information 

1 5 for any selection including how to deal with gaps m the profile by evaluating and 

interpolating other available information. Some example computer code written in a 
variation of the Lisp programming language is presented in the Appendix. 

The first stage of completion results in an edit decision list which is a set of 
uistructions for the assembly of this specific message by a video editing function using 

20 the message resource library 26. This causes a high quality video stream of the message 

to be generated which is then sent together with its ID to the transcodiog operation, which 
is described below. 

Another embodiment of the present invention for delivering personalized 
messages is shown in Fig. 9. This embodiment is an example of personalized message 

25 creation as a service industry, where clients send requests electronically to a service 

provider, who creates the personalized message and sends the pCTsonalized message 
either back to the client, or directly to the user. The personalized message may be 
displayed to the user immediately, or alternatively, the personalized message may be 
stored by the requesting client to provide to the user at a later time, either by web page or 

30 by otlier delivery methods 155, such as hard media (video tapes, video disks, dvd etc), or 

by electronic means (email, cable TV, satellite etc.). 
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The client 130 sends a request, including a user identification to the server 134. 
The user identification 132 provides information identifying the user, to allow for 
searching and obtaining user profile infonnation. A standard user identification such as a 
user email address, domain number or social security number may be used, or a specific 
user identification used or created by the client. The server sends a request to the system 
20 which is providing the service.- The server 134 also indicates a particular campaign to 
be used for creatuig the user-specific personalized message. A campaign scheduler 142 
sets up and queues the creation of the personalized message by the system 20. 

Upon commencement, the profile server 503 gathers profile information 60 on tlie 
user. The profile server 503 can obtain profile uiformation firom many sources, including 
databases 200, as previously described. The profile server 503 then sends the gathered 
information including the user profile information 60, message template 56 information 
and specific campaign rule information to the message generator 145. The message 
generator 145 uses expert rales 38 as well as other sources of environmental and temporal 
data 147 (such as weather, time, current events etc.) to select appropriate media segments 
for completion of the message template 56. The message generator then sends a media 
playout list 148 to the assembly system 36, which obtains the appropriate media segments 
fi-om the databases 26 and produces the personalized message. Depending on the 
delivery requirements, the personalized message may be sent directly to the delivery 
target 155, or may be encoded by a media encoder 40 which performs any conversion or 
compression necessary to produce a deKverable personalized message. 

Another embodiment of the present invention is shown in Fig. 10. This 
embodiment is similar to the embodiment in Fig. 9, except with more focus on message 
creation and delivery over the internet or world wide web. This is an example of "just in 
time" creation on demand, to display to a user who is actively viewing a web site on 
which the personalized message will be immediately displayed. 

Turning to Fig. 10, A client browser 130 sends a user identification 132 to the 
web server 134. The user identification 132 is sent along with a campaign identification, 
which indicates what campaign to use to create the personalized message for the user. 

The web server 134 passes the received information on to the transaction 
processor 138, typically over an electronic connection such as the internet, a dedicated 
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telephone connection etc. The transaction processor 138 oversees much of the operation 
of creating the personalized message, including sequencing of many of the steps in the 
operation, and bookkeeping for client records and billing. For creating the personalized 
message, the transaction processor 138 send the user identification 132 to the profile 
server 503, which gathers profile information 60 on the user, as previously described. 
This profile information 60 is returned to the transaction processor 138. 

The transaction processor 138 sends the campaign identification to the campaign 
scheduler 142, which schedules and sets up tasks and actions to be performed in the 
personalized message creation. The campaign scheduler controls the performance of the 
message generator 145. The message generator 145 receives the profile information 60 
and fiirther information 144 (such as parameters associated with tlie campaign) from the 
transaction processor 138. 

The message generator 145 provides the profile information 120 and message 
template 56 to the expert rules system 38, which is responsible for completing the 
message template 56 with selected media segments for each part of the template. The 
expert rules system 38 uses rules as previously described to detemiine the appropriate 
media segments. The completed template 146 is then returned to the message generator 
145 which sends a media playout list 148 to the transaction processor 138. 

The transaction processor 138 provides the media playout Ust 148 to the media 
server 149 which assembles all the media segments together to produce the video stream 
1 50 of the personalized message. The video stream 1 50 is provided to the media encoder 
40, to properly encode the video stream for delivery. In the present embodiment, this is 
an encoded video stream 154 which is sent to the client browser 130, for delivery to the 
user. 

In this embodiment, the transaction processor 138, profile server 503, campaign 

scheduler 142, message generator 145 expert rules server 38, media server 149 and media 
encoder 40 run on separate general purpose computers running Windows NT or Linux. 
These computers are interconnected as appropriate for the location of each component 
and the bandwidth requirements for communication therebetween. Alternatively, several 
components may run on one machine as one application, or as separate processes. 

In an alternative embodiment, the present invention may be implemented with a 
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plurality of message templates for one campaign, with, a template selection mechanism 
for selecting an appropriate template based on profile information for the end user, or on 
other factors. For example, if it is presently raining in a location where the end user is, a 
message template created with bad weather in mind may be selected over a "good" 
weather message template, or a generic template. These plurality of message templates 
may have common insertable message segments, or use different libraries of insertable 
message segments, or even have few or no insertable message segments. 

Although the invention has been shown and described witli respect to illustrative 
embodiments thereof, various other changes, omissions and additions in the form and 
detail tiiereof may be made therein without departing from the spirit and scope of the 
invention. 

What is claimed is: 
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APPENDIX 



; ; ; SAMPLE EXPERT RULE FOR PRESETTING A SET OF USER-DEFINED 
AND ;; /ENVIRONMENT PARAMETERS 

(define Mobil (user user_age user_language user_sex 
middle_age user_card user_zip) 



( 



(age 



(cond 



) 



< user_age 13) child) 

< user_age 20) teen) 

< user_age 35) young) 

< user_age 60) middle) 

< user_age 85) senior) 
t elderly) 



(weather (getenv (weather user_zip) ) ) 
20 (temperature (getenv (temperature 

user_zip) ) ) 

(language user_language) 
(sex user_sex) 
(category 

25 (cond 

( (and (equal user_language 
German) (equal user_sex Male) (< user_age 35) ) F) 

( (equal user_card amex) E) 
( (equal user_card mobil) D) 
30 ( (and (equal user_sex Male) 



(< user_age 35) ) A) 
Female) (> user_age 35)) C) 



( (and (equal user_sex 
(t B) 



) 



) 
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) 



; / ; ; SAMPLE EXPERT CODE WHICH DEFINES A PLAYLIST 
5 (la vol); load audio source 

(aap 1 (BLACK . 36));aap is apend audio playlist 
(aap 1 ((VOl . "16:29:42;13" ) . 853)) 
(aap 1 (BLACK . 11)) 
(la TechnoAl) 

10 (aap 0 ((TechnoAl . "16 : 01 : 05 ; 23 " ) . 892)) 

(aap 0 (BLACK . 8)) 

(Is Kj) 

(Is KeyPinal) 

(Is Kaa) 
15 (Is Ku) 

;;ap is append playlist, parameters are a video segment, 

pulled ;;by reference index, and a length value, measured in 



frames 












(ap ( 


(Kj . "16:52:54;20" ) 




40)) 




(ap ( 


(KeyFinal 


"00:00:14 


21" 




16)) 


(ap ( 


(KeyPinal 


"00:00:15 


25" 




3)) 


(ap ( 


(KeyFinal 


"00:00:15 


10" 




3)) 


(ap ( 


(KeyFinal 


"00:00:15 


25" 




3)) 


(ap ( 


(KeyFinal 


"00:00:15 


16" 




3)) 


(ap ( 


(KeyFinal 


"00:00:15 


25" 




3)) 


(ap ( 


(KeyFinal 


"00:00:15 


22" 




28)) 


(ap ( 


(KeyFinal 


"00:00:17 


13" 




5)) 


(ap ( 


(KeyFinal 


"00:00:16 


25" 




147)) 


(ap ( 


(KeyFinal 


"00: 00: 17; 13" 




5)) 


(ap ( 


(Kaa . "18 


12: 38; 19" 




6)) 




(ap ( 


(Kaa . "18 


12 : 39; 09" 




6)) 




(ap ( 


(Kaa . "18 


12: 39; 29" ) 




6)) 




(ap ( 


(Kaa . "18 


12:40; 19" ) 




5)) 




(ap ( 


(Kaa . "18 


12: 41; 09" ) 




7)) 




(ap ( 


(KeyFinal 


"00:00:22 


28" 


) . 


61)) 


(ap ( 


(Ku . "17:41:24;29" ) 




4)) 




(ap ( 


(Ku . "17:^ 


11; 25; 13" ) 




4)) 
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(ap 


((Ku . "17 


41 


25 


•27" ) 




4)) 






(ap 


( (Ku . "17 


41 


26 


•11" ) 




4)) 






(ap 


( (Ku . "17 


41 


26 


•25" ) 




4)) 






(ap 


( (Ku . "17 


41 


27 


-09" ) 




4)) 




5 


(ap 


( (Ku . "17 


41 


27 


■23" ) 




4)) 






(ap 


( (Ku . "17 


41 


28 


•07" ) 




4) ) 






(ap 


( (KeyFinal 




00 


00 :26 


01 


• ) . 


37) ) 




(ap 


( (KeyFinal 




00 


00 :26 


17 


• ) . 


11) ) 




(ap 


( (KeyFinal 




GO 


00:27 


22 


■ ) . 


108) ) 


10 


(ap 


( (KeyFinal 




00 


00:32 


16 


• ) . 


8)) 




(ap 


( (KeyFinal 




00 


00 :32 


16 


' ) . 


20)) 




(ap 


( (KeyFinal 




00 


00: 32; 16 


' ) . 


B) ) 




(ap 


( (KeyFinal 




00 


00 :32;16 


" ) . 


325) ) 




(ap 


(BLACK . 3 ) ) 












15 


(at 


0 (text "Visible World" 


0. 


1 0.20 


35 "C 



0.5) 60); at is apply text, for text graphics 

(at 0 (text "527W, 34th street" 0.1 0.35 40 "Courier" 0.0 

0.5 0.5) 60) 

(at 0 (text "New York, NY 10001" 0.1 0.50 40 "Courier" 0.0 
20 0.5 0.5) 60) 

(at 0 (text "www.visibleworld.com" 0.1 0.65 40 "Courier" 0.0 
0.5 0.5) 60) 

(at 60 (text "Prepared for:" 0.1 0.20 40 "Courier" 0.0 0.5 
0.5) 60) 

25 (at 60 (text "Sonara" 0.1 0.35 40 "Courier" 0.0 0.5 0.5) 60) 

(at 60 (text "English" 0.1 0.5 40 "Courier" 0.0 0.5 0.5) 60) 
(at 60 (text "Date : 01/19/00 " 0.1 0.65 40 "Courier" 0.0 0.5 
0.5) 60) 

(at 60 (text "Time : 15 : 52 : 10" 0.1 0,80 40 "Courier" 0.0 0.5 
30 0.5) 60) 
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CLAIMS 

1 . A system for dynamically creating a personalized message for an intended 
5 audience, comprising: 

a message campaign, defining a narrative framework for said personalized 
message, said message campaign including: 

■a message template, comprising a plurality of media segment slots; 
a plurality of media segments, each media segment corresponding to one 
1 0 of said media segment slots of said message template, wherein several of said 

media segments correspond to a same one of said media segment slots of said 
message template; 
a plurality of expert rules; and 

a message assembly component, responsive to user profile data of said intended 
1 5 audience to apply said plurality of expert rules to said user profile data in order to select 

appropriate media segments for each of said media segment slots of said message 
template, in order to assemble said personalized message for said intended audience. 

2. The system of claim 1 wherein said intended audience has no direct control over 
20 said narrative framework for said personalized message. 

3. The system of claim 1 wherein said message assembly component also uses 
environmental or temporal information in order to select appropriate media segments for 
assembling said personalized message. 

25 

4. The system of claim 1 wherein said media segments are selected from the group 
including audio, video, background, animation, synthesized graphics and voice. 

5 . The system of claim 1 wherein several of said media segments which correspond 
30 to a same one of said media segment slots of said message template are of different 

lengths, and said message template appropriately adjusts said personalized message based 
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on a length of a selected one of said media segments. 

6. The system of claim 1 wherein said personalized message is assembled 
immediately before presentation to said intended audience. 

7. The system of claim 1 wherein said user profile data of said intended audience is 
obtained from a plurality of user information data sources. 

8 . The system of claim 7 wherein said message campaign includes a target entity 
profile, said target entity profile providing an indication of appropriate media segments 
for selected user profile data. 

9. The system of claim 8 wherein said target entity profile provides an indication for 
selecting said intended audience from said user information data sources. 

10. A method for dynamically creating a personalized message for an intended 
audience; said method comprising: 

obtaining user profile data for said intended audience; 
selecting a message template, said message including a plurality of media 
segment slots; 

applying a plurality of expert rules to said user profile data and said message 
template, in order to select, firom a plurality of media segments, appropriate media 
segments for insertion into said plurality of media segment slots in said message 
template; 

assembling said personalized message using said message template and said 
selected media segments; and 

providing said assembled personalized message in a format for delivery to said 
intended audience. 

1 1 . The method of claim 10 wherein said message template and plurality of message 
segments are created as part of a message campaign, which defines a narrative framework 
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for said personalized message. 

12. The method of claim 10 wherein said steps of assembling said personalized message 
and providing said assembled personalized message is performed immediately before 
5 delivery to said intended audience. 
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NEXT PROFILE^ 
Name : Mary Johnson 
Gender : Female - 
\Zip Code : 01776 — 
ge:32 - 

ID : miay5@aol.com 



ASSEMBLE NEXT MESSAGE 
BY RULES 
3 1 . Select Category Value Appropriate to Profile 

Range Values 



Category 
#i Age 



#ii District by 
Zip Code 



# ill Region by 
Zip Code 

#iiii Gender' 



21 to 34 

35 to 54 
55 & over 

DN = 00000 

NE = 01000-07000- 

MA = 20000 - 30000 

SE = etc. 

!\/lW = etc. 

W = etc. 

N = 01000 -etc. 

8 = ?????- etc. 



F = Female - 
M = Male 



Step 2. Select Appropriate Resource Segments for Video & Audio Tracks 
Video Tracks Audio Tracks 

VI : 1b A! : lb 

VII : 1b,2c,3b4c, ... All : lb, 2c, 3b, 4c, ... 
VIII : la, 2a, AMI : 1a, ... 

Villi: la, ... Aim: la 

step 3. Use Selections witfi Template to Create Complete Edit Decision List 
Step 4, Send EDL to Video Editor for Auto Assembly to Template Format 
Step 5. Assembled Video Message with ID Goes to Transcode Operation 



FIG, 8 
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